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(57) Abstract: The invention relates to a method of optimizing the presentation on a display screen of objects of a user interface 
which can be freely positioned and scaled by means of control elements. This is realized by means of a predetermined calculation 
rule in such a manner that the objects can be automatically varied between a still readable minimum size and a selected maximum 
size in dependence on the object contents, selected preferred settings and the available display resource on the display screen, and 
that the available display screen surface is optimally filled, possibly while eliminating less important details of the object contents 
and while changing the display mode of the object contents and/or the object as well as while avoiding mutual overlapping of the 
objects. 
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Method of optimizing the presentation on a display screen of objects of a user interface 
which can be freely positioned and scaled by means of control elements 



The invention relates to a method of optimizing the presentation on a display 
screen of objects of a user interface which can be freely positioned and scaled by means of 
control elements. 



It is known that computers nowadays are operated via so-called user interfaces 
which present the functions of the associated operating system or its applications in the form 
of graphical objects (windows). 

Because of their user friendliness, such user interfaces have become very 
popular notably in the private domain. For example, in this respect reference can be made to 
the graphical user interface "Microsoft Windows". But also in the technical domain, for 
example, generally also in the field of patient monitoring, graphical user interfaces are also 
frequently used, because these interfaces enable the simultaneous presentation of a plurality 
of objects on the display screen; for example, in the case of medical applications these 
objects relate to the blood pressure, the cardiac frequency or the like, and also represent 
graphically the variation thereof. 

The user normally has the possibility of moving the objects on the surface of 
the display screen, to scale them and to configure the type of presentation, that is, to 
individually arrange a plurality of objects on the display screen. Manipulation of the object 
contents, that is, of the information to be displayed, however, is usually not at all possible or 
to a limited extent only. For example, if only the contents of a directory are to be displayed, 
the user automatically receives additional information in the form of the file size of the 
individual files. Automatic suppression of such additional information because of a limited 
display resource on the display screen is not possible. Consequently, the object contents and 
hence the information to be displayed remain the same. 

The object contents also remain the same in the case of object scaling. For 
example, when the object is scaled down, additional scrolling lists are often provided on the 
side in order to enable continued viewing of the entire object contents. Automatic adaptation 
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of the object contents, for example, in such a way that information which is less important 

because of the smaller representation is automatically suppressed, is not possible. 

Matters are the same in the case of zooming of the object contents. Only a 

simple enlargement/reduction of the overall object contents by a predetermined factor then 
5 takes place. Adaptation of the object contents so that, for example, only a detail of the object 

contents is enlarged/reduced, is not possible. 

Automatic adaptation of the user interface to a changing operating 

environment usually is not possible either. For example, when the computer is used as a 

measuring computer and the user has configured the user interface in such a manner that 
1 0 several measuring rows can be simultaneously displayed as objects and one of the 

measurements temporarily does not deliver results, only the latter is displayed as information. 

Automatic switching over of the display to another, available measuring row is not possible. 

Granted, some user interfaces in the field of patient monitoring have facilities 

for limited adaptation to changing circumstances, but such user interfaces have the drawback 
1 5 that the user cannot individually adjust the size and position of the objects. 

Therefore, it is an object of the invention to provide a method of representing 
objects on a user interface which can be freely positioned and scaled by means of control 
20 elements, thus enabling optimum display of object contents while avoiding said drawbacks. 

In accordance with the invention this object is achieved as disclosed in claim 
1 . Further features of the invention are disclosed in the dependent claims. 

The invention is based on the recognition of the fact that a calculation rule can 
be applied so as to transform the objects to be displayed into intelligent objects for the 
25 computer, thus ensuring optimum representation of the relevant objects or object contents in 
a user surface. 

In accordance with the invention, the objects can be automatically changed, in 
dependence on the object contents, the selected preferred settings and available display 
resources on the display screen, between a minimum size which can still be read and a 
30 predetermined maximum size by means of a selected calculation rule, that is, in such a 
manner that optimum filling of the available display screen surface is achieved, possibly 
while suppressing less important details of the object contents and while changing the display 
mode of the object contents and/or the object as well as while avoiding mutual overlapping of 
the objects. Such automatic adaptation of the objects holds in principle for all kinds of objects 
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or object contents to be continuously presented on the user interface in a clearly arranged 
manner. 

For example, the objects or the object contents may concern dynamically 
variable information, for example, temporal recordings of a measuring value, static 

5 information such as, for example, the output of a directory, as well as commands and various 
options for further processing/manipulation (also referred to as menu buttons hereinafter). 

This is very advantageous in particular for patient monitoring, because the 
user, for example, a physician or a nurse, is continuously presented with all-important 
objects, such as selected patient information and associated menu buttons, in optimum 

10 readable form on the display screen for the purpose of further processing/manipulation. Thus, 
the time-consuming manual adjustment of the display screen surface is no longer necessary. 

In accordance with the invention the objects are arranged within a fixed 
hierarchy so that when the display resource on the display screen is not sufficient, objects can 
be automatically suppressed, that is, starting with the lowest hierarchical level. As a result of 

15 the automatic suppression of less important objects, the display resource thus made available 
ensures a clearer display again of the remaining object contents on the display screen in a 
simple manner. 

Because of the flexibility, the ordering of the hierarchically combined objects 
can be changed. For example, objects can be added or also be removed. However, the 
20 formation of intermediate hierarchies is also feasible, for example, in order to ensure more 
clarity in the case of a large number of hierarchically combined objects. 

A plurality of objects can be combined so as to form a group in accordance 
with the invention. The combination of a plurality of objects so as to form a group offers the 
advantage that adjustments can be performed simultaneously for a plurality of objects in a 
25 simple manner. The respective adaptability is then maintained for the individual objects. For 
example, when a group of objects is reduced in such a manner that readability of all objects 
of this group is no longer ensured, less important objects of the group are automatically 
eliminated so as to ensure optimum readability of the remaining objects combined in the 
group. As an alternative for the suppression of individual objects in the group, the object 
30 representation of individual objects in the group can be changed, for example, a 

representation of individual objects as so-called switching surfaces. In that case such a 
switching surface again is a surface-optimized representation of the intelligent object only. 

A preferred embodiment of the invention takes into account the behavior of 
the objects relative to one another and the interaction between a plurality of objects in 
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relation to the display resource. This is very advantageous notably with a view to ease of 
operation and optimum use of the display resource. For example, when special settings are 
realized for a first object via menu functions, requiring a further adjustment via a menu 
function for a second object, the corresponding second menu for this second object is 
5 automatically displayed. Furthermore, for example, if a display on a larger display screen is 
desired, the adapted behavior of the objects relative to one another ensures automatic 
adaptation of the objects to the additional display resource. For example, objects, notably the 
previously described menu buttons, can also indicate pictograms in the case of an adequate 
display resource, which pictograms are automatically eliminated again when the display 

10 resource becomes inadequate. 

In respect of the adapted behavior of the objects relative to one another, the 
further feature concerning automatic substitution of the objects amongst themselves is 
particularly advantageous. For example, if an object temporarily does not produce relevant 
data, a second object which delivers relevant data is automatically displayed instead. 

1 5 In accordance with the invention the objects can be briefly displayed in 

enlarged form in dependence on a given trigger signal which is produced by a control 
element defined by an object selection/marking. This feature is particularly advantageous 
with a view to ease of operation. For example, when the user requires a given object, for 
example, a menu button or the like, the user can briefly display the objects in enlarged form 

20 on the user interface simply by "touching" by means of a cursor, thus enabling simplified 
selection. 

Preferably, for the display of the objects on the display screen there are 
provided respective rectangular surfaces. The rectangular surfaces offer the advantage that 
the objects can be simply positioned on the display screen and that optimum use of the 
25 available display screen surface is ensured. 

In conformity with a preferred embodiment of the invention, medical 
information, notably information for patient monitoring, is used as the object contents. 

The invention also relates to a device for the simultaneous compressed optical 
representation of the object data on a graphical user interface, which device includes an 
30 arithmetic unit for carrying out the method. The arithmetic unit is provided with a calculation 
program which optimizes the representation of object data in conformity with predetermined 
criteria in such a manner that, possibly while e lim ina t ing less important details of the object 
contents and while changing the mode of display of the object contents and/or the object as 
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well as while avoiding mutual overlapping of the objects, the filling of the available display 

screen surface area is optimum. 

Also provided is a control element for generating a trigger signal for the brief 

enlargement of selected/marked objects. 
5 Also provided are input means whereby the display can be modified. The input 

means co-operate with medical measuring devices which form the statistic and dynamic 
information of the objects. 

Further advantages and feasible applications of the present invention will 
become apparent from the following description which is given with reference to the 
1 0 embodiment shown in the drawing. 

The invention will be described more or less schematically hereinafter on the 
basis of an embodiment for medical applications as shown in the drawing, however, without 
the invention being restricted thereto in any way. 

15 

The terms and associated references as stated in the attached list of references 
will be used in the description, the patent claims, the abstract and the drawing. Therein: 
Fig. 1 is a diagrammatic representation of a plurality of objects of a user 
interface as used in the field of patient monitoring; 
20 Fig. 2 shows the user interface of Fig. 1 with associated object contents; 

Fig. 3 shows two objects from a user interface which can be changed 

automatically; 

Fig. 4 shows a further object which can be changed automatically; 

Fig. 5 shows a further detail of an object from a user interface for patient 

25 monitoring; 

Fig. 6 shows another user interface from the field of patient monitoring with a 
briefly enlarged object; and 

Fig. 7 shows a further user interface from the field of patient monitoring with a 

differently configured display. 

30 



Fig. 1 shows a user interface 10 of the kind used for patient monitoring. The 
user interface 10 is composed of aplurality of rectangular objects 12. For the sake of clarity, 
only three objects are provided with a reference numeral 12 in Fig. 1. 
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The arrangement of the rectangular object 12 is chosen to be such that 
overlapping of individual objects is avoided. The surface area of the rectangular objects 12 
corresponds each time to the space available for the representation of the contents of an 
object on the display screen surface (referred to hereinafter as the display resource). 
5 The user interface 10, or the objects 12 of the user interface 10, can be 

individually configured at all times by means of special control elements (not shown here) 
such as a keyboard, a mouse, pens or the like, in a manner which is known per se. For 
example, the arrangement of the individual objects relative to one another can be adjusted at 
will and the size of the individual objects can also be scaled individually. 
10 Fig. 2 shows the user interface 10 of Fig. 1 with the associated object contents. 

As has already been stated, the objects to be displayed can be selected at will. In the present 
example inter alia a plurality of dynamically varying patient data, such as an ECG 
(electrocardiography) curve (derivative I) 14, a further ECG curve (derivative II) 16, an 
oxygen saturation curve 18 as well as a C0 2 respiratory curve 20, are shown in the form of 
15 curves. To the right of the curves 14, 16, 18 and 20 the corresponding curve values are shown 
in the form of a numerical display. For example, adjacent the ECG curve 14 there is shown 
the instantaneous cardiac frequency 22 with the associated alarm limits 24. The same holds 
for the curves 16 to 20. 

Further patient information displayed on the user interface 10 concerns the 
20 blood pressure 26, a first body temperature 28 and a second body temperature (different 
measuring location) 30, together with the associated alarm limits 32, 34 and 36. 

In order to carry out adjustments on the user interface 10, for example, a 
change of the alarm volume or the like, a plurality of objects 12 (referred to hereinafter as 
menu buttons 38) is provided in the lower region. The adjustment by way of the menu 
25 buttons can be carried out by means of various input means such as a keyboard, a mouse, pen 
elements or by touch screen input. 

All of the objects 12 can be automatically changed by means of a calculation 
rule which controls the computer in such a manner that optimum filling of the available 
display screen surface is achieved in dependence on the object contents 14 to 38, selected 
30 preferred settings and available display resources on the display screen, possibly while 

suppressing less important details of the object contents and while varying the display mode 
of the object contents and/or the object as well as while avoiding mutual overlapping of the 
objects. 
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Because the objects 12 can thus be automatically changed, they can also be 

referred to as intelligent objects. 

Fig. 3 illustrates the variability of the representation of object contents as well 
as the suppression of less important detail information of object contents on the basis of two 

blood pressure displays 40. 

Whereas in the left part of Fig. 3 various possibilities are given for display of a 
pulsating blood pressure indication 42, the right part of Fig. 3 shows various possibilities for 
display of a non-pulsating blood pressure 44. 

Because it is recognized whether the blood pressure is pulsating, the display is 
automatically adapted in conformity with the display mode 42 or 44. 

The various possibilities for display of the pulsating blood pressure 42 show, 
by way of example, how the object contents are adapted to a reduced object surface by means 

of a calculation rule. 

The top left representation is the starting point of the description. The known 

1 5 and customary two-line blood pressure presentation comprises a systolic value 46, a diastolic 
value 48 as well as a mean value 50 which is stated between brackets. Furthermore, 
additional information is displayed in the form of an indication 52, a physical unit 54 as well 
as appropriate alarm limits 56. Because the values 46, 48 and 50 concern the central 
information, their display is clearly larger than that of the other information 52, 54 and 56. 

20 if only a minor change of the display is required, the central information 46, 

48 and 50 is scaled down in a simple manner, be it only to such an extent that good 
readability is still ensured. The other information 52, 54 and 56, already being shown at a 
smaller scale, however, retains its original size because a further reduction would lead to 

problems in respect of readability. 
25 If a further reduction of the object surface is required, a change-over takes 

place automatically from the two-line display to a single-line display of the central 
information 46, 48 and 50. The other information 52, 54 and 56 still retains its original size as 
described previously. If an even smaller display of the object contents is required, automatic 
elimination of the less important other information, such as the physical unit 54 and the alarm 
30 limits 56, takes place as appears from Fig. 3 . 

The same holds for the display of the non-pulsating blood pressure 44. Again 
the object contents are first simply reduced. For the case where even less space is available 
for the object, a change of the object contents takes place by eliminating less important detail 
information as described above. 
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The Figs. 4 and 5 show further examples of the adaptation of the objects 12 or 
the object contents to changing display resources. Fig. 4 again shows various possibilities for 
display of a numerical value, halothane and C0 2 , each time for inhalation and exhalation 58, 
and Fig. 5 shows a variation of the ST segment in the electrocardiogram 60 with minimum 
5 and maximum deviation and the short term trend of the derived measuring value. Fig. 5 
shows above all that the object contents can be displayed in different manners. 

A plurality of objects 12 can be grouped together and put in hierarchical order. 
As a result, less important objects 12 can be eliminated, if necessary, for example, 
automatically. The additional display resource thus obtained is then used for optimized 
10 display of the remaining objects 12. 

The combination of a plurality of objects so as to form a group makes sense 
notably when, for example, it is necessary to scale down/scale up a plurality of objects 12 
simultaneously or to import these objects on a different display screen. 

The automatic adaptation of objects 12, however, is not limited to the relevant 
15 object contents 14 to 36. For example, automatic adaptation of the objects 12, notably of the 
menu buttons 38 is possible (not explicitly shown) in dependence on the control element 
(mouse control as opposed to input via a rotary knob), the accuracy of the control element 
(touch screen input requires more object surface than input via a mouse cursor) and in 
dependence on the type of use (user is present in the direct vicinity of the user interface or in 

20 a more remote location). 

These objects 12, such as menu buttons 38, can also be ordered in a 
hierarchical fashion and be structured in groups. In conformity with the foregoing 
description, this combined "control structure", notably its display, is then adapted exactly as 
simply as already described for the object contents 14 to 36. Depending on preference, the 

25 combined control structure can be displayed by means of simple scroll lists or in the form of 
columns. 

Fig. 6 shows a further user interface 62 of the kind used for patient 
monitoring, that is, with a briefly enlarged object 64. The briefly enlarged object 64 is a 
menu button which, when touched by the cursor, is briefly assigned a larger display surface 
30 so that it can be better recognized from a distance. This briefly enlarged representation of an 
object can be used analogously for other objects. For example, it can be used as a 
"magnifying glass" for simplified reading of a measuring value. 

Fig. 7 shows a further user interface 66 with a display configured in a different 
manner. Fig. 7 demonstrates above all the flexibility with which the various objects 12 can be 
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displayed. For example, in this user interface 66 not only information concerning a single 
patient is displayed. The upper region of the user interface 66 also contains information 
concerning other patients. To this end it was merely necessary to combine each time the 
necessary objects so as to form a group. The optimum display of the grouped objects after 
import in the user interface 66, however, takes place automatically by means of the selected 
calculation rule as has already been described. 
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CLAIMS: 



1 . A method of optimizing the presentation on a display screen of objects of a 
user interface which can be freely positioned and scaled by means of control elements by 
means of a predetermined calculation rule in such a manner that the objects can be 
automatically changed, in dependence on the object contents, selected preferred settings and 
available display resource on the display screen, between a minimum readable size and a 
selected maximum size in such a manner that optimum filling of the available display screen 
surface is achieved, possibly while suppressing less important details of the object contents 
and while changing the mode of display of the object contents and/or the object as well as 
while avoiding mutual overlapping of the objects. 

2. A method as claimed in claim 1 , characterized in that the objects are arranged 
within a fixed hierarchy in order to enable automatic suppression of objects, starting with the 
lowest hierarchical level, in case the display resource on the display screen is insufficient. 

! 5 3. A method as claimed in the claims 1 and 2, characterized in that the ordering 

of the hierarchically combined objects can be changed. 

4. A method as claimed in one of the preceding claims, characterized in that a 

plurality of objects can be combined so as to form a group by means of the control elements. 



10 



20 



5. A method as claimed in one of the preceding claims, characterized in that the 

behavior of the objects relative to one another and the interaction of various objects with one 
another in relation to the display resource are taken into account. 



25 



6. A method as claimed in claim 5, characterized in that objects can be 

automatically substituted among themselves. 
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7. A method as claimed in one of the preceding claims, characterized in that the 

objects can temporarily be displayed in enlarged form in dependence on a given trigger signal 
which is produced by a control element which is defined by object selection/object marking. 

5 8. A method as claimed in one of the preceding claims, characterized in that the 

contents of an object contain static information as well as dynamically variable information 
and/or commands and various options for processing/manipulation. 

9. A method as claimed in one of the preceding claims, characterized in that 
10 respective rectangular surfaces are provided for the display of the objects on the display 

screen. 

10. A method as claimed in one or more of the preceding claims, characterized in 
that the static and dynamic information of the object contents is medical information, notably 

1 5 information for patient monitoring. 

11. A device for the simultaneous compressed optical display of object data on a 
graphical user interface, which device includes an arithmetic unit for carrying out the method 
claimed in one of the preceding claims, characterized in that the arithmetic unit is provided 

20 with a calculation program which optimizes the display of object data in conformity with 

given criteria in such a manner that optimum filling of the available display screen surface is 
achieved, possibly while suppressing less important details of the object contents and while 
changing the display mode of the object contents and/or the object as well as while avoiding 
mutual overlapping of the objects. 



25 



12. A device as claimed in claim 1 1 , characterized in that there is provided a 

control element whereby a trigger signal can be generated for the brief enlargement of 
selected/marked objects. 



30 



13. A device as claimed in one of the claims 1 1 or 12, characterized in that there 

are provided input means whereby the display can be changed. 
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14, a device as claimed in one of the claims 1 1 to 13, characterized in that the 

input means co-operate with medical measuring devices which form the statistic and dynamic 
information of the objects. 



WO 03/104966 



1/7 



PCT/TB03/02100 



CM 






CM 



WO 03/104966 



PCT7IB03/02100 



3/7 




WO 03/104966 



PCT/IB03/02100 



4/7 



CO 



CD O 

CO 

oin < qiq 


coo 

<r otn <! piq 


CD O 

< 010 <*! qm 
5 t^co X r^cvl 
£ "5> 


CO p 
CO ^ 

<| om < piq 
X r^co X r^cs 



o 



CO 
CO 



CO « 

co • 



$ OK) 



CO 
CO 



p lO 

co 



CO 
CO 



p 



LO 
CO 

S3 



LO 
CO 



CM 1 

LO 
CO 




LO 

CO- 


I 


1 I 



CO p 

CO ^ 



om oin 



CO O 

CO "5t 



o»o pin 



CO"vf" 

om P*> 

c 



X, 
a> 



CO 
CO 



O 



CO 

CO 

|s3 



o 

Si-** 



CD 
CO 

OU) 

r^co 



o 

■ 

|S3 



CD 



WO 03/104966 PCT7IB03/02100 



5/7 




O 



